Papers with WMT17 Chinese-English
Multi-Head Attention with Disagreement Regularization (D18-1)
Copied to clipboard
| Challenge: | Existing methods to encourage diversity among multi-head attention are limited. |
| Approach: | They propose a disagreement regularization term to encourage diversity among attention heads . they validated their approach on EnglishGerman and ChineseEnglish translation tasks . |
| Outcome: | The proposed approach improves translation performance across language pairs on English-German and Chinese-English translation tasks. |
A Study of Reinforcement Learning for Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Recent studies have shown that reinforcement learning (RL) is an effective approach for improving the performance of neural machine translation systems. |
| Approach: | They propose to leverage reinforcement learning to boost the performance of NMT systems trained with monolingual data. |
| Outcome: | The proposed method achieves competitive results on translation tasks in English-German, Chinese-English and English-English systems. |
Breaking the Representation Bottleneck of Chinese Characters: Neural Machine Translation with Stroke Sequence Modeling (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing research treats Chinese character as a minimum unit for representation . however, such representation suffers from two bottlenecks: 1) learning bottleneck; 2) parameter bottleneck, each individual character has to be represented by a unique vector. |
| Approach: | They propose a representation method for Chinese characters to break the representation bottlenecks . they map each stroke to a specific Latin character, thus allowing similar Chinese characters . |
| Outcome: | The proposed representation method breaks two representation bottlenecks in Chinese character representation . it maps each stroke to a specific Latin character, thus allowing similar Chinese characters to have similar representations . |
Exploiting Deep Representations for Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Neural machine translation models typically implement encoder and decoder as multiple layers, but only the top layers are leveraged in the subsequent process, which misses the opportunity to exploit useful information embedded in other layers. |
| Approach: | They propose to expose all of these signals with layer aggregation and multi-layer attention mechanisms and introduce an auxiliary regularization term to encourage different layers to capture diverse information. |
| Outcome: | The proposed approach exposes all of these signals with layer aggregation and multi-layer attention mechanisms on widely-used translation datasets. |